Naudts-like duality and the extreme Fisher information principle 
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I. INTRODUCTION 



II. A BRIEF FISHER PRIMER 
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We are going to be concerned in what follows with the 
workings of two information measures that have received 
much attention lately, those of Fisher and Tsallis 
, respectively. Our goal is to show that their inter- 
play naturally yields a type of Naudts' duality ||. 

Fisher's information measure (FIM) was advanced 
already in the twenties, well before the advent of Infor- 
mation Theory (IT), being conventionally designed with 
the symbol I || (see Eq. fl2.l| ) below for the pertinent 
definition). Much interesting work has been devoted to 
the physical applications of FIM in recent times (see, for 
instance, and references therein). Frieden and 

Soffer jjj have shown that Fisher's information measure 
provides one with a powerful variational principle, the 
extreme physical information (EPI) one, that yields the 
canonical Lagrangians of theoretical physics Ad- 
ditionally, / has been shown to provide an interesting 
characterization of the "arrow of time" alternative to the 
one associated with Shannon's S ® [h| . 

Tsallis' measure is a generalization of Shannon's one. 
Notice that IT was created by Shannon in the forties 
|jn1 , fl2f . One of its fundamental tenets is that of assigning 
an information content (Shannon's measure) to any nor- 
malized probability distribution. The whole of statistical 
mechanics can be elegantly re-formulated by extremiza- 
tion of this measure, subject to the constraints imposed 
by the a priori information one may possess concerning 
the system of interest ]T^] . It is shown in that 
a parallel process can be undertaken with reference to 
Tsallis' one, giving rise to what is called Tsallis' ther- 
mostatistics, responsible for the successful description of 
an ample variety of phenomena that cannot be explained 
by appeal to the conventional one (that of Boltzmann- 
Gibbs-Shannon) 



Fisher's information measure I is of the form 



dx f(x, 9) 



1 df 
L/(s,0) 89 



(2.1) 



where a; is a stochastic variable and 9 a parameter on 
which the probability distribution f(x, 0) depends. The 
Fisher information measure provides a lower bound for 
the mean-square error associated with the estimation of 
the parameter 9. No matter what specific procedure we 
chose in order to determine it, the associated mean square 
error e 2 has to be larger or equal than the inverse of the 
Fisher measure [pi. This result, i.e., e 2 > j, is referred 
to as the Cramer-Rao bound, and constitutes a very pow- 
erful statistical result [pj . 

The special case of translation families deserves special 
mention. These are mono parametric families of distri- 
butions of the form f(x — 9) which are known up to the 
shift parameter 9. Following Mach's principle, all mem- 
bers of the family possess identical shape (there are no 
absolute origins), and here Fisher's information measure 
adopts the appearance 



(2.2) 



The parameter 9 has dropped out. / = /[/] becomes 
then a functional of /. 

At this point we introduce the useful concept of escort 
probabilities (see || and references therein), that one 
defines in the fashion 
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dx 



F q (x) 



Jf(x)idx' 

q being any real parameter, J F q (x)dx = 
course, for q — 1 we have F\ = f. 

The concomitant "escort-FIM" becomes 



(2.3) 



1, and, of 



1 



I[F q ] = J dxF q {x) 



1 dF q {x) 



F q (x) dx 

that, in terms of the original f(x) acquires the aspect 
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(2.4) 



I[F q ] = q 



J dxf(x) 



9-2 



0/(n 



dx 



fdxf(x)« 
3 the 

/ dxf(x)i- 2 



(2.5) 



We shall denote with I q the new "escort-FIM" 



df{x) 
dx 



fdxf(x)i 



(2.6) 



(Notice that for q = the integration range must be finite 
in order to avoid divergences in the denominator.) 

The parameter q can be identified with Tsallis' nonex- 
tensivity index |Tg|-[i"5]], which allows one to speak of 
"Fisher measures in a nonextensive context" . Their main 
properties have been discussed in pq] . 



so that, defining an action A q 



A.n 



h - J, 



(3.2) 



EPI asserts that the whole process described above ex- 
tremizes A q . FS conclude that the Lagrangian for 
a given physical environment is not just an ad-hoc con- 
struct that yields a suitable differential equation. It pos- 
sesses an intrinsic meaning. Its integral represents the 
physical information A q for the physical scenario. On 
such a basis some of the most important equations of 
Physics can be derived for q = 1 (l]j|] . For an interesting 
Quantum Mechanical derivation see [[l7| . A cosmological 
application of the nonextensive (q ^ 1) conservation law 
( |3.lD is reported in |jl8). Mechanical analogs that can 
be built up using this law are discussed in Notice, 
however, that the last two references use an old Tsal- 
lis' normalization procedure (advanced in |l3|Ji"4| ]), that 
cannot be assimilated within the framework of the escort 
distribution concept. 



III. THE EXTREME PHYSICAL INFORMATION 
PRINCIPLE (EPI) 

The Principle of Extreme Physical Information (EPI) 
is an overall physical theory that is able to unify sev- 
eral sub-disciplines of Physics fl]||. In Ref. |jj Frieden 
and Soffer (FS) show that the Lagrangians in Physics 
arise out of a mathematical game between an intelli- 
gent observer and Nature (that FS personalize in the 
appealing figure of a "demon" , reminiscent of the cele- 
brated Maxwell's one). The game's payoff introduces the 
EPI variational principle, which determines simultane- 
ously the Lagrangian and the physical ingredients of the 
concomitant scenario. 

FS Q envision the following situation, involving 
Fisher's information for translation families: some physi- 
cal phenomenon is being investigated so as to gather suit- 
able, pertinent data. Measurements must be performed. 
Any measurement of physical parameters appropriate to 
the task at hand initiates a relay of information / (or I q in 
a non-extensive environment) from Nature (the demon) 
into the data. The observer acquires information, in this 
fashion, that is precisely / (or I q ). FS assume that this 
information can be elicited via a pertinent experiment. 
Nature's information is called, say, J Jl|,||. 

Assume now that, due to the measuring process, the 
system is perturbed, which in turn induces a change S J. 
It is natural to ask ourselves how the data information 
I q will be affected. Enters here FS's EPI: in its relay 
from the phenomenon to the data no loss of information 
should take place. The ensuing new Conservation Law 
states that 5 J = SI q , or, rephrasing it 



S(I q - J) = 0, 



(3.1) 



IV. SOLUTIONS TO THE VARIATIONAL 
PROBLEM 

According to EPI, J is fixed by the physical scenario 
We adopt here a more modest posture by assuming 
that J embodies only the normalization constraint, and 
say nothing regarding a specific physical scenario. J is 
just 



J = X f(x) dx, 



(4.1) 



where A is the pertinent Lagrange multiplier. Such a J 
has been successfully employed in [[nj with reference to a 
quantum mechanical problem. Playing the Frieden-Soffcr 
game, i.e., performing the variation (3.1), leads then to 



2/ /+(<?- 2) f 2 + qI q f 2 + X 



f-i = (4.2) 



a q-dependent, non- linear differential equation that 
should yield our "optimal" probability distribution / (we 
set Q = f f q dx). Now, one should demand that, for 
q = 1, (4.2 ) become identical to the differential equation 



that arises in such circumstances (see that equation in 
|l7| , for instance, and call A the concomitant Lagrange 
multiplier used there). This requirement is fulfilled if we 
set A = A — ql q . The q = 1-expression becomes then 



2//- f 2 + X' f 2 = 0, 



(4.3) 



wher e, of course, one has Q = 1. The solution of Eq. 
(4.3) is of the form 



f q= i{x) — A 2 cos 2 k(x — xq) 



(4.4) 



where k is a constant to be determined below and A, x$ 
are arbitrary integration constants. 
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It easy to show that (4.2) has, as a first integral, 



with 



f 2 + I q f + XQ f-o = c f 2 ~ q , (4.5) 

where c is an integration constant. This equation involves 
Fisher's generalized information for translation families. 
We must solve it having (2.6) in mind. In order to estab- 
lish the consistency between ( |4.5| ) and ( |2.6| ) we introduce 
a set of normalized variables 



Lax, A = — — , c= — 



(4.6) 



( the in tegr al is a n inde finit e one) in terms of which Eqs. 
(|1|, (Hj]), (Q, and (|J) are transformed into 



If q - 2 f' 2 dz 
Jf q dz ' 



(4.7) 



(4.8) 



(an indefinite integral), 

2/ /" + (q - 2) f' 2 + q f + X f-i = 0, (4.9) 

and 

f' 2 + f + A f- q = c f 2 -i. (4.10) 



Inserting (4.1C) into (2.6) we conclude that the inte- 
gration constant acquires the aspect 



2 Q + A 

X2 — Xl ' 



(4.11) 



where a^2 and a;i are the integration limits, to be fixed 
by the remaining parameters of the theory. A quite in- 
teresting point is that the general solution of (-1-1L ) can 
be given in closed form as 



dz = z — const. = ± 



/ 



Vc-Xf-f" 



df, (4.12) 



where the constants c, A must be of such nature that a 
real / ensues. 



V. SYMMETRY PROPERTIES OF THE EPI 
PROBABILITY DISTRIBUTION 



We start by changing variables in ( |4.9| ) to 

/(*) ' 

and obtaining 

u" + auu' + f3u 3 +ju = 0, 



(5.1) 



(5.2) 



(2 g-1), f3 = -q(q-l), 7 = [3. 



(5.3) 



(A complete study of the properties of equation (5.2) is 
found in (2(]]). Further, we effect the transformation 



/ - 1//, 



so that 



-u, u 



(5.4) 



(5.5) 



If we require that equation ( |5.2| ) be invariant under this 
transformation, the parameters a, (3 and 7 must change 
according to a — > —a, [3 — > [3 and 7-^7 respectively. 
This entails that the parameter q, that characterizes the 
degree of non-extensivity of the system, transform as q — > 
1 — q. A property of this type has been called "duality" 
by Naudts |], although in his case the relationship is of 
the form q — * ~ (duality between q > 1 statistics and 
q < 1 one). In our case, the duality arises between two 
q- values whose sum adds up to unity. 

Introducing now into (O) the new variable 



h = 



r 



(5.6) 



we get 

2hh" - (q + 2)ti 2 - qh 2 - Xh q+1 = 0, (5.7) 
which under the substitution q — > 1 — q, becomes 

2hh" + {q- 3)/i' 2 + (q - l)h 2 - Xh 2 - q = 0. (5.8) 
This equation can be rewritten, if we first define 

w{q) = {-ti 2 -h 2 ~ Xh 2 - q + ch 3 - q ), (5.9) 

as 

2hh" + (q- 2)h' 2 + qh 2 - ch 3 - q + w{q) = 0, (5.10) 

where the terms in w (q) correspond to the (transformed) 
first integral of (4.9) 



f' 2 + f + A/ 



3-g 



cf 



2-9 



which under (5.6) becomes 

h' 2 + h 2 + Xh 2 - q = ch 3 ~ q . 



(5.11) 



(5.12) 



As a consequence, w(q) in ( |5.10 ) vanishes and the 
equation (4.9), under the transformation (5.6), turns out 
to retain its form, changing q — * 1 — q and c — > —A. It is 
convenient at this point to effect a slight change of nota- 
tion and denote by f q the solution to ( |4.9| ) that obtains 
when the nonextensivity index is q. The above symmetry 
argument entails 



3 



f q (c,\) 



/l-g(-A,-c) 



(5.13) 



Using this symmetry property we can re-obtain the 
probability distribution (L4) for q = 1, i.e., the ordinary, 
extensive one, in term of the probability distribution for 
q = 0, that can be easily calculated from ( 4.1 0| ) 



f' 2 = (c-l) f 
The solutions are 
:- 1 



A/ 3 



fo(z) -- 
and 

Hz) 



A 



1 - tanh* 



q = Q. 



(z - z Q ) 



1 + tan 



(z - z ) 



(5.14) 

c > 1, 
(5.15) 

c < 1, 
(5.16) 



where the last solution must be normalized in a finite 



interval. The symmetry transformation (5.13) yields now 
the general solution for q = 1 



/i(c,A) 



/o(-A,-c) 



(5.17) 



This is to be compared with the result (4.4). We start 
with (pTq), effect the transformation (5.17) and reach 



fi(z) 



2 Vl + A , > 
cos (z — zo) 



(5.18) 



1 + A 2 
which, after a little algebra that involves also going back 



to the x variable adopts indeed the form (4.4) with A 2 = 
c/X' and k = VA/2. A similar analysis can be performed 



for ( |5T5| ). 

We have thus found the general solution for the (exten- 
sive) EPI variational treatment corresponding to a J that 
entails just normalization of the probability distribution. 
Notice that, within the context of Naudts' effort B, the 
extensive thermostatistics q = 1 is self-dual. Instead, 
according to the present Fisher framework, the self-dual 
instance obtains for q = 1/2. 



VI. CONCLUSIONS 

We have shown that the EPI principle, used in con- 
junction with a Fisher measure constructed with escort 
distributions that depend upon the Tsallis index q, ren- 
ders a probability distribution endowed with a remark- 
able symmetry: a Naudts'-like duality ||. 

Tsallis enthusiasts had thought, before the advent of 
Naudts work ||, that a different statistics obtains for 
each different value of the nonextensivity index q. The 



duality concept is then important because it ascribes the 
same statistics to a given pair of (suitably related) q- 
values. We have shown here that such a pair can be 
selected in two distinct manners, i.e., a la Naudts or a la 
Fisher, and have detailed the prescription corresponding 
to the latter choice. 

Finally, we have also ascertained which is the general 
(normalized) probability distribution that extremizes the 
physical information. 
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